Quadratures of Pontryagin Extremals 
for Optimal Control Problems* 

Eugenio A. M. Rocha Delfim F. M. Torres 

Department of Mathematics 
University of Aveiro 
3810-193 Aveiro, Portugal 

{eugenio , delf im}@mat .ua.pt 



Abstract 

We obtain a method to compute efTective first integrals by combining 
Noether's principle with the Kozlov-Kolesnikov integrability theorem. A 
sufficient condition for the integrability by quadratures of optimal con- 
trol problems with controls taking values on open sets is obtained. We 
illustrate our approach on some problems taken from the literature. An 
alternative proof of the integrability of the sub-Riemannian nilpotent Lie 
group of type (2, 3, 5) is also given. 
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1 Introduction 

Optimal control problems, with controls taking values on an open set, are now 
subject to strong investigation because of their recent applications to mod- 
ern technology such as "smart materials" JO]. Geodesies of (sub)-Riemannian 
manifolds can also be seen as solutions of a class of these problems [2]. Mean- 
while, solutions of optimal control problems are closely related with solutions of 
Hamiltonian equations through the Pontryagin Maximum Principle |13j . In 
the literature, Hamiltonian equations are usually classified as integrable or 
non-integrable. However, it was not always clear in what sense a system is 
(non)integrable, as the following quotations confirm mCj: Birkhoff comment 
"when, however, one attempts to formulate a precise definition of integrability, 

'Presented at the 4th Junior European Meeting on "Control and Optimization", Bialystok 
Technical University, Bialystok, Poland, 11-14 September 2005. Research Report CM05/I-48. 



many possibilities appear, each with a certain intrinsic theoretic interest"; and 
the dictum of Poincare "a system of differential equations is only more or less 
integrable". The reasons are the existence of three main approaches to study 
integrabihty (the dynamical system approach through bifurcation theory, the 
analytic approach using singularity analysis and Painleve property, and the al- 
gebraic approach through differential geometry), which are not always compat- 
ible, and the stratification of the phase space in regions that may be integrable 
with different notions. 

On the Control Theory setting, integrabihty concerns the existence of a 
foliation as the collection of all maximal integral manifolds of the underlying 
distribution (see Frobenius and Nagano-Sussmann theorems ^Hl)- On the other 
hand, integration by quadratures of a differential equation is the search for 
representing the solutions by a finite number of algebraic operations, inversion 
of functions, and calculations of integrals of known functions ("quadratures"); 
where a precise meaning of integrabihty defines the allowed operations and 
the set of known functions. Hence, an optimal control problem is integrable 
by quadratures if the corresponding Hamiltonian equations are integrable by 
quadratures. Since, an optimal control problem can be integrable and not inte- 
grable by quadratures, and it is frequent to shortcut integration by quadratures 
to integration, we will adopt the word "solvability" to mean "integrabihty by 
quadratures" of optimal control problems. 

In the algebraic approach, verification of solvability of an optimal control 
problem frequently requires the existence of a set of first integrals (or conser- 
vation laws) of the true Hamiltonian equations, and an appropriate method 
of reduction. The process can be divided in three steps: (i) find a sufficient 
number of first integrals; (ii) verify that such first integrals imply the exis- 
tence of quadratures; and (iii) apply a method to find the quadratures. The 
first step can be attained by methods such as the Noether's theorem, find- 
ing Casimirs, or even solving the PDE that appear in the definition of varia- 
tional symmetry. The second step can be accomplished by using theorems such 
as Bour-Liouville, Liouville- Arnold (abelian case), Mishchenko-Fomenko (non- 
abelian case), or Kozlov-Kolesnikov. Last step is usually a consequence of the 
choices on the first and second steps, e.g. Liouville-Poincare method, Cartan 
method, or Prykarpastsky method. Notice that step (i), alone, is not enough 
to solve the problem, since any function of a set of first integrals is a first 
integral |Z| pp. 27], meaning that there exists plenty first integrals that are 
useless. 

In this work, we use the algebraic approach to derive in ^a method for com- 
puting effective first integrals (steps (i) and (ii)) for optimal control problems by 
combining Noether's symmetry theorem with the Kozlov-Kolesnikov integrabil- 
ity theorem (recalled in Section Sj^l . Main result gives a sufficient condition for 
the solvability of a given optimal control problem (Theorem . A key issue is 
the construction of a system of algebraic equations whose solutions determine 
the set of effective first integrals, based on the simple observation that for op- 
timal control problems Noether's theorem usually gives a parametric family of 
first integrals. The proposed method is applied in ^to concrete optimal control 
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problems from the literature. An alternative proof to ^31 for the solvability of 
the sub-Riemannian nilpotent Lie group of type (2, 3, 5) is presented in SjSJ 



2 Preliminaries 
2.1 The problem 

The optimal control problem consists to minimize a cost functional 

I[x{-),u{-)]^ f C{t,x{t),u{t))dt (1) 

J a 

subject to a control system described by ordinary differential equations 

i{t)^^{t,x{t),u{t)) (2) 

together with certain appropriate endpoint conditions. The Lagrangian C : 
[a,b] X R" X R™ ^ R and the velocity vector ip : [a,b] x R" x R™ R" are 
given, and assumed to be smooth: £(•, •, •), ip{-, ■, •) E . We are interested in 
the case where there the control set is open: u{t) E U C R™, with U a open set. 
We denote the problem by (P). In the particular case (p{t, x, u) — u, one obtains 
the fundamental problem of the calculus of variations, which covers all classical 
mechanics. The choice of the classes X and U, respectively of the state x : 
[a, b] R" and control variables u : [a, b] R™, are important for the problem 
to be well-defined. We will assume, for simplicity, that X — PC^ {[a, 6]; R") and 
W = PC([a,6];R™). 

The Pontryagin Maximum Principle |il3| is a necessary optimality condition 
which can be obtained from a general Lagrange multiplier theorem in spaces of 
infinite dimension. Introducing the Hamiltonian function 

H{x, u, ifj, t) — —C{t, x,u) + ip ■ ^{t, X, u) , (3) 

where ^i, i = 1, . . . ,n, are the "Lagrange multipliers" or the "generalized mo- 
menta", the multiplier theorem asserts that the optimal control problem is 
equivalent to the maximization of the augmented functional 

j[x{-)M-)M-)]= I iH{x{t),u{t),m,t)-m-m)dt. 

J a 

Let ^a;(-), {t(-), solve the problem, and consider arbitrary C^-functions 

hi jh^ : [a, b] R", hi{-) vanishing at a and b {hi{-) E Cq {[a, b])), and arbitrary 
continuous /i2 : [a,b] R™. Let £ be a scalar. By definition of maximizer, we 
have 

J \{x + ehi){-), {u + e/i2)(-), (V- + e/i3)(-)l < J u{-), V^(-) 
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and one has the following necessary condition: 

(i + ehi)(-), (u + eh2){-), {^j + e/i3)(-) 
Differentiating Q gives 

dH 



d J 

de 



6 = 



(4) 







dH 

dx 

+ 



(^x{t),u{t)J{t),t^ . hi{t) + — (^£{t),u{t),ij{t),t^ ■h2{t) 
(x{t), u{t),ij{t), ■ hsit) ~ hsit) ■ i{t) - i,{t) ■ hi{t) 



dH 



Integrating the ipit) ■ hi{t) term by parts, and having in mind that hi{a) 
hi{b) — 0, one derives 



dH 



+ 



dt^O. (5) 



Note that © was obtained for any variation hi(-), /i2(-)i ^^'^ ^si')- Choosing 
hi{t) — h2{t) = 0, and ft.3(-) arbitrary, one obtains the control system 



OH / \ 
Ht) = ^ [m, uit),^{t), ij , te [a, b] . 

With hi(-) arbitrary, and h2{t) — h^{t) = 0, we obtain the adjoint system: 

dH 



dx 



x{t),u{t),ijit),t] , te[a,b]. 



(6) 



(7) 



Finally, with /i2(') arbitrary, and hi{t) /i3(t) — 0, the stationary condition is 
obtained: 

dH / \ 

— {xit),u{t),i^it),tj=0, te[a,b]. (8) 

Hence, a necessary optimality condition for to be a minimizer of 

problem (P) is given by the Pontryagin Maximum Principle: there exists 

such that the 3-tuple ^a;(-), {t(-), satisfy all the conditions © , 0, and (jHJ. 

We recall that conditions ©, l?)), and ((SJ imply the equality 



dt 



dH 

H [i{t),u{t),ij{t),t) = — [i{t),u{t),ij{t),t 



(9) 



We assume, without loss of generality, that there exist at least one fc £ Nq 
such that 

d d^ dH 

3 {x,^,t) e M : ___(:,, ^ 0. (10) 
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Further, we denote by ku the smahest of such k and by u the solution of the 
equation 

d^^ 3H 

^ — i.,u,^,t)=0 (11) 

with respect to u; giving as true Hamiltonian the expression 

'H{x,ip,t) ^ H (x,u,il},t) . (12) 

A mapping F{x, ^, t) is a, first integral of the Hamiltonian equations with Hamil- 
tonian 7i(x,'0,t) if 

dF 

_ + {H,F} = 0, (13) 
where {•, •} denotes the canonical Poisson bracket. 

Remark 1. The restriction for the control set to he open is crucial. For closed 
control sets U the stationary condition become, the more general, maximal- 
ity condition H{x{t),u{t),ijj{t)) — maxy^u H(x(t),v,Tp(t)), and for such cases 
the true Hamiltonian may be discontinuous. Our approach, through symplectic 
geometry, can only deal with at least Hamiltonians. 

Remark 2. // there exists a mapping G{x, tp) such that {Ti., G} = cH for some 
c S K, then F{x,ip,t) = G{x,ip)—ctli.{x,'ip) is a (nonautonomous) first integral. 

Remark 3. On this work we will consider nonautonomous problems, for such 
reason we define the extended cotangent space o/R" by M = {x} x (W^)* {ip} x 
R{t}. However, notice that a nonautonomous Hamiltonian on M" is not sig- 
nificantly different from an autonomous Hamiltonian on M""*"^, since a nonau- 
tonomous Hamiltonian H{x,'ip,t) with Hamiltonian system 

. dH • dH 

X = — and ip = — — 
dip ox 

can be transformed into an autonomous Hamiltonian K{x, ip, 9, t) = H{x, ip, t) — 
with Hamiltonian equations 

dK ■ dK . dK . dK 

The reverse procedure partially justifies the statement that an autonomous Hamil- 
tonian is always a first integral for the problem, so the equations of an au- 
tonomous Hamiltonian can be dimension-reduced. Furthermore, a system with 
only one degree of freedom is always integrable. 



2.2 Noether's theorem 

In 1918 Emmy Noether established the key result to find conservation laws in 
the calculus of variations jl2| . We sketch here the standard argument used to 
derive Noether's theorem and conservation laws in the optimal control setting 

(cf. e.g. ismni). 
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Let us consider a one-parameter group of C-'^-transformations of the form 

hs{x,u,ip,t) = (^h^{x,u,^p,t),h'^{x,u,ilj,t),hf{x,u,^,t),hl{x,u,^,t)'^ , (14) 

where s denote the independent parameter of the transformations. We require 
that to the parameter value s — corresponds the identity transformation: 



hoix, u, tp, t) = [hQ{x, u, tp, t), h^{x, u, ip, t), U!^{x, u, tp, t), hl{x, u, ^p, t) 



(15) 



Associated to the group of transformations (|14|l we consider the infinitesimal 
generators 



T{x,u,^p,t)^ —hl{x,u,^p,t) 
as 



U{x,u,ip,t)^ —h"{x,u,'ip,t) 



s=0 



, X{x, u, ip, t) = -j-K{x, u, ip, t) 
as 



, ^ix,u,t,^P) = —hf{x,u,'il;,t) 



s=0 



(16) 



s=0 



Definition 1. The optimal control problem (P) is said to be invariant under a 
one-parameter group of C^-transformations H14|) if, and only if, 



ds 



H{hs{x{t),u{t),4,{t),t)) 

dhl(x(t),u(t),-il)(t),t) 



-ht{x{t),u{t),ij{t),t) 



dt 



dh\{x(t),u{t),'tp{t),t) 
dt 



dhl {x{t),u{t),i;{t),t) 
dt 



s=0 



(17) 



with H the Hamiltonian Q. 

Having in mind (|15|l . condition H17() is equivalent to 

dH dH dH dH , , , d d 

(18) 

where here all functions are evaluated at (x{t),u(t),'ilj(t),t) whenever not indi- 
cated. Along a Pontryagin extremal (x(-), u(-), V'(-)) equalities ©, Q), ©, and 
© are in force, and l|18|l reduces to 



Therefore, we have just proved Noether's theorem for optimal control problems. 
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Theorem 1 (Noether's Theorem). If the optimal control problem is invari- 
ant under (|14l) . in the sense of Definition^ then 

i){t) ■ X {x{t),u{t), ij{t), t) - H {x{t),u{t), ipit), t) T {x{t), u{t),'ijj{t),t) = const 

(20) 

(t e [a,b]; T and X are given according to ()16() ; H is the Hamiltonian ^) is 
a conservation law, that is, (|2UI) is valid along all the minimizers (a;(-),u(-)) of 
(P) which are Pontryagin extremals. 

2.3 Solvability and Reduction 

E. Bour and J. Liouville, on the middle of the XIX century, obtained funda- 
mental concepts and results concerning integrability by quadratures of differ- 
ential equations. Namely, the notion of elementary function: a C" function 
that belong to the set A of elementary functions. The set A is obtained from 
rational functions on C'^ (fc G No), using a finite number of the following op- 
erations: (i) algebraic operations (if /i,/2 G A then fi*f2 & A, where ★ is 
either the addition, subtraction, multiplication, or division); (ii) solutions of 
algebraic equations with coefRcients in A; (iii) differentiation; and (iv) exponen- 
tial and logarithm operations. The set of elementary functions together with 
the operation of integration (if / e A then J f{x) dx e A) is called the set of 
Liouvillian functions. Liouville (1939) showed that the solution of the equation 
x{t) = - is only LiouviUian for a = -2 and a = 4fc/(l - 2k) {k e N). 

There is a concrete method that permits not only to verify that solutions 
of the Hamiltonian system are Liouvillian functions, but also to reduce the 
system in order to obtain the extremals. We describe it briefly. Let A/ = 
W{x} X (M")*{V'} X R{t} and / : M ^ R be a first integral of the Hamiltonian 
system with Hamiltonian TC. If df{q) ^ 0, then in some neighborhood of the 
point q G M there exist symplectic coordinates {x, 9, i) such that f{x, -i/', i) = 
ipi. In these coordinates 7i does not depend on aii, therefore if we fix a value 
f = tpi = c, then the Hamiltonian system will only have n—1 degrees of freedom. 
In order to have an effective reduction of dimension by a set of first integrals, 
this method requires the first integrals to be independent and in involution 

{/^,/,} = Vi,je {!,..., iV}. 

E. Cartan ^ extended Liouville's method for the case where the algebra L 
of first integrals is not commutative, and possible infinite-dimensional. Cartan 
assumed that the first integrals satisfy the relation 

{/«,/j} = C.,(/i,---,/jv) Vz,je {!,..., TV} (21) 

for some (nonlinear) functions Qj : M.^ M. His method is based on the 
following theorem. 

Theorem 2 (S.Lie - E. Cartan). |^ Let F = (/i, . . . ,/jv)- Suppose that the 
point c e M.^ is not a critical value of the mapping F and that in its neighborhood 
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the rank of the matrix {Cij ) constant. Then, in a small neighborhood U C M.^ 
of c, one can find N independent functions 0j : f/ — > R such that the functions 
= o F : V ^ M, where V — F~^{U), satisfy the relations 

{$1, $2} = • ■ ■ {4'2,,-l, $2r,} = 1, 

whereas the remaining brackets vanish, and the rank of the matrix (Cij) is 'i.rj. 

Using Theorem |21 we can lower the order of the system in the foUowing 
way: the level set Mc = {(a;,-;/') G M : ^j{x,ip) = cj, I < j < N}, where c = 
(ci, . . . , cjv) satisfies the theorem, is a smooth (2n — A^)-dimensional submanifold 
of M. The theorem also implies that there is an action of the commutative group 
R' {I — N — 2ri) on Mc, generated by the phase flows of the Hamilton's equations 
with Hamiltonians <f>j for j > 2r/. Now, thanks to the functional independence 
of the integrals <i>j, this action has no fixed points. Hence, if its orbits are 
compact, then the quotient space Mred = Mc/M} is a smooth manifold with 
dimension 2(n — N + r]) endowed with a natural symplectic structure. Let H' 
denote the restriction of the Hamiltonian H to the level set Mc of the first 
integrals. Since H' is constant on the orbits of the group MJ", there is a smooth 
function H^cd ■ ^red ~^ IK such that the diagram 

Mc ^ Mred M <^ Mc 

commutes. To end, let us observe that one can obtain Liouville's method from 
Cartan's method by choosing Cij = and r] — 0. Locally they give the same 
result, however the factorization by Cartan method can be accomplished globally 
only under more restrictive assumptions. 

Kozlov-Kolesnikov 13 proved an intermediate result, considering that Pois- 
son brackets of first integrals are a linear combination of first integrals. In fact, 
this result is more suitable for our purposes. 

Theorem 3 (Kozlov-Kolesnikov). Suppose that the Hamiltonian H : M" x 
{R")* xR^R hasn first integrals i^i, . . . , F„ : R" x (R")* x R ^ R that satisfy 
relation 

n 

BC^eR" : {F.,F,}=J2C'Fs Vz, j e {1, . . . , n}, (22) 

s=l 

where = iCi i ■ ■ ■ iCf )'^- Additionally, assume that 

1. on the set Mf = {(x, ijj, t) G M : Fi{x, iJ,t) = ri,l < i < n} the functions 
Fi, . . . , Fn are independent; 

2. (ri, . . . , r„)e-'' = for all n}; 

3. the Lie algebra L of linear combination ^^^CiFi, ct £ R, is solvable. 

Then the solutions of the Hamiltonian system lying on Mf and can be found by 
quadratures. 
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3 Main Results — effective first integrals 



In order to use Noether's theorem (Theorem^ to obtain effective first integrals 
for the Hamiltonian equations, we need to compute the solutions of the first 
order partial differential equation (|I9|I considering the optimal control u, i.e. 

dX{x,^,t) dT{x,^,t) 
-^(t) \-H{x,i},t) — = 0, (23) 

where X{x,ip,t) = X {x,u,tp,t) and T{x,i}j,t) = T {x,u,ip,t). A particular 
solution (if exists) can be found, e.g. by the well known method of (additive) 
separation of variables for PDE, assuming 

r(x,V,0 = T"{t)+T-^{x,) + --- + T--ixn)+T^'{i^i) + --- + T^Hi'n), 

X{x,^P,t) = X°{t)+X'''{xi) + --- + X''-{Xn) + X'^'{iji) + --- + X'^"{ijn). 

In particular, we will consider that each independent component of T and X 
have a polynomial structure with degree < pd, hence 

nx,^,t) = Y.lcj{t,)t^+j2cjifiKq.r], (24) 

X,{x,^,t) = (Co^(z,/i)i''+^C,^(z,Ai)(g,)M , (25) 

for some constants Cj{fi), Cj{fi), CQ{i, y),C^{i, ^) e M and X — [Xi, . . . ,Xn)- 
Now, since equation H23I) have to be valid for every extremal {x{t), ipit), t) G 
M, this particular choice for the structure of solutions will transform the PDE 
problem for T, X into an algebraic system of equations for the constants Cj (fi), 
Cj(/z), CQ{i,fi), C^{i,fi) e M. The algebraic system is under-determined, 
because we have one equation for two unknowns T and X. Therefore, if such 
system has a nontrivial solution, we have a family of first integrals. Let us define 
the mapping F : M™ C(M, R) by 

r{X){x,ij,t)='iJj-X -HT (26) 

for A e M™. r is a linear mapping, whereas T and X are linear with respect 
to the constants, the PDE H23|l is a linear first order equation (superposition of 
solutions is a solution), and equation (|20|l is a linear functional combination of 
T and X. We resume our statements in the following lemma. 

Lemma 1. Assume that equation l^2Sl) has nontrivial solutions T(x,ip,t) and 
XlXjipjt), respectively of the form \24\l and ^25}) . Then the mapping F is a 
linear m-parametric family of first integrals with respect to X G M™, i.e. it 
depends on m £ Nq arbitrary constants Ai, . . . , Am and 

VA e M™ : + {H, r(A)} = 0. (27) 
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Considering the previous lemma, makes sense to assume that F has the 
following structure 



r(A)(a;>,i) =^rfe(x>,i)Afc, (28) 

k=l 

. , Am) G M™. We call F k the components of the family of first 



where A — (Ai, 
integrals r(A). 

Let n be the dimension of the phase space {x £ R"), m the number of 
parameters on the family F(A), and m > n. The existence of n effective first 
integrals (in the sense of Kozlov-Kolesnikov) will be related with the existence of 
a nontrivial solution of a system of algebraic equations involving the components 
of F and their canonical Poisson brackets. Consider the following system of 
algebraic equations 



[XT 



b{x,ij,t), t<j e{l,...,n}, (29) 



where A\ . . . , A" G and f-?' e M" 
^(a;>,i) = ({r„rj)" 



and b(x, ip, t) — [Fi 



F V 



By a solution of the system of equations (|29|l we mean a set of constant vectors 
(A^, . . . , A"), (^^^, . . . ,^("~i)") that satisfies the system. A nontrivial solution 
is a solution for which all A'" (fc = 1, . . . ,n) are different. From a nontrivial 
solution, we have the set of first integrals {F(X^), ■ ■ ■ , F(A")}. Comparing with 
relation (|21l) . Qj are linear functions. Therefore, the space of linear combinations 
L — span{F(A^), . . . , F(A")} forms a noncommutative but finite-dimensional 
Lie algebra, where the first integrals define a basis and the coordinates of ^^-^ 
are the structure constants. 

Proposition 1. If there exists a nontrivial solution (A^, . . . , A"), {S,^^ , ■ ■ ■ , ^("~i)") 
to the system 1^29^) . then the set of first integrals {F(A^), . . . , F(A")} satisfy re- 
lation 



Proof. The set {F(A^), . . . , F(A")} is a set of first integrals of the Hamiltonian 
Ti, since F(ci, . . . , Cm){x, ip, t) is a first integral for any (ci, . . . , Cm) G R™; by 
Theorem Hand Lemma Q] Relation (I22|l is satisfied, using the definition of F 
H28|) . properties of the bracket, and relation (|29|l . For i < j G {1, . . . we 
have: 

{F(V),F(A^)} = FpA;,^ F,A^, = E E A;A^,{Fp,FJ = (y)^A(:r, V', t)A^' 



p=i 



(e 



9=1 
1\T n 



(A^) 



p=l 9 = 1 



F(A^) 
F(A'") 



^e:^F(A^ 



□ 
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Proposition 2. Assume that the set of first integrals {r{X^), • ■ • , F(A")} satisfy 
relation \2S}^) . Let S — {(a, g, z, j) £ {1, . . . , n}'^ x {1 . . . , m}^ : a < b,p < 
q,a<p,i <j}. If 

ef^f^CrV V(a,5,p,g,z,j)G5, (30) 

then the Lie algebra L of linear combination CsF{X''), Cs G M, is solvable. 

Proof. Let L'^ = L. We recall that a Lie algebra L is solvable if the descent 
series is nilpotent, i.e. 

3ken:L^ = where L^ = [L^-^ , L^-'^]. (31) 

For our purpose it will be enough to consider k = 2. Let us observe that the 
Liouville method (first integrals in involution) is the case k — \. Hence, for 
fc = 1 and using relation (|22|l . 

(a„/?6~/?„Q5){r(A"),r(A')} 

b 

^^(a./3,-/3.a,)5rV(A'), 

i a<b 



|^a.r(A»),^/3,F(A'')| = ^ 



and, for A; = 2, 



E E ( ( E(°"/3, - /3.a,)cf ) - /3p«,)er ) 

s 2<j V \a<b / \p<q / 

\P<IJ / \a<b I I 

E E E E("''^'' " /3<^«<>)(«p/3, - (cf ~ ^r?f ) ?3^/"(a^ 

s z< j a<b p<q 



□ 

We are now in conditions to present the main result of the paper: a practical 
method to find effective first integrals for optimal control problems. Theorem^] 
is a direct consequence of PropositionsnjandEJ and Kozlov-Kolesnikov theorem. 

Theorem 4. Assume that the optimal control problem has a solution, 

and there exists a m-parametric family of first integrals F , given by Lemma^ 
with the form 

ni 

F{X){x,^P,t)^J2Fk{x,^p,t)Xk, 
fc=i 

where A = (Ai, . . . , A„i) £ M™. LetS = {{a,b,p,q,i,j) e {1, . . . ,n}^x{l . . . ,to}^ : 
a<b,p<q,a<p,i<j}, Aix, 4,, t) = ({Fp, F q})^^^^, A = [(A^)^, . . . , (A")^]^ G 
Mnxm, and b{x,i),t) = [Fi, . . .,Fm]^. 
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If there exists a solution {\^ , . . . ,X^,^^^, . . . , <^'^"~^)", ri, . . . ,r„) (with A' S 
M™, ^ij g ]gri^ n e R and i < j G {l,...,n}) of the algebraic system of 
equations 

A{x,tp,t)\^ -{C^YKb{x,ij,t) ^ 0, /orVi < j e 

= 0' /orVi <jG{l,...,n}, 
and 

rank [V(,,^)r(Ai), . . . , V(,,^)r(A")] = n (32) 

on t/ie manifold M/r — [a Cz M : F{X^){a) — Tj}, then the optimal control 
problem OP-Q) is solvable on Mfr. 

Although simple, the arguments behind Lemma ^ and Theorem ^ give a 
powerful method that can be applied with success to several problems of optimal 
control. 

4 Illustrative Examples 

We now present three interesting applications, many others can be chosen from 
the literature. Families of first integrals (Lemma ^ were obtained using the 
Maple package described in 8 . 

Example 1. Let us show the integrability by quadratures (solvability) of the 
following optimal control problem 

^ ( xi{t) ^ ui{t) cos{x3{t)) 

- uiitf + U2{tf dt min , I i2(t) = Ui(t) sin(a;3(i)) 

[ X3{t) = U2{t) 

which is known as the Dubin's model for the kinematics of a car ^] Example 18, 
pp. 750-751]. The true Hamiltonian is 

n = ^ ([cos {x3{t))Mt)+ sin {X3{t)) Mt)f + [Mt)?) ■ 

It is clear that the problem has three trivial first integrals (f.i.) {7i,tpi,4'2} 
in involution. Notice that an autonomous Hamiltonian is always a f.i. by Re- 
mark|3| and the other f.i. follow from Remark|21 However, by computing F(A) 
on Lemma Hand applying Theorem^ we obtain the trivial f.i. and an extra 
effective f.i. F — —tpiX2 + i'2Xi + V'3- Therefore, the set {-0i,-02,F} can also 
be used to prove the solvability of the problem. 

Example 2. An interesting variation of the previous problem is the model of 
a car with one-trailer (Q, parameterized by constants (a, 6,c) G M, 

ui cos(a;3) 
ui sin(x3) 
\ui tan(M2) 

jjUi (^ tan(M2) cos(a;3 — X4) — sin(x3 — X4)) 



/ Ui + u^dt ^ min , 

J a 
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The necessary and sufficient condition of invariance is satisfied with the following 
generators {T = C2, A^i = -C1X2 + X2 = CiXi + C3, X^^Ci^X^^ Ci). It 
follows that, for C = (Ci, C2, C3, C4) G M^, 

r(C)(a;, V, i) = (C4 - C1X2) + (C3 + ^1X1)^-2 + Cx-^zii) + Ci^/.4 - C2W. 

Therefore, a possible solution of the algebraic system of Theorem 0] is = 
(1,0,0,0), = (0,0,1,0), A3 = (0,0,0,1), A^ = (0,1,0,0), ^'^ = (0,0,-1,0), 
= (0,1,0,0), ^ (0,0,0,0), = (0,0,0,0) for i = 1,2,3, and r = 
(ci, 0, 0, C4) for any ci, C4 S M. The set of effective first integrals is 

{r(Ai) = -i,rx2 + V'2Xi + ^3 + V^4, r(A2) = V2, r(A3) = ^x,f{\^) = n}. 

Comparing with the last example, which is linear in the control, this problem is 
not only nonlinear in the control as it has a very complicated true Hamiltonian. 
However, the set of first integrals is just an extension of the previous one, where 
the only change is F(A^) = F + -04. 

Example 3. We now consider the so-called flat Martinet problem [3]: 



For a = the problem is clearly integrable by using the trivial set of first 
integrals {Ti, "01, ■i/'s} in involution (remarksElandlSJ. In the a 7^ case, one has 
the invariance-generators {X2 = 0, ^'2 = 0, T = 2 A4 + A^, *i = -A^^i, Ui = 
-A1mi,4'3 = -X^i-Jz,U2 = -Aiu2,^3 = X^X'i + X^.Xi = Ai(a~i + xi)}, which, 
after solving the algebraic system of Theorem^gives the following set of effective 
first integrals 



This example shows that the method not only generate mappings F{x,^) veri- 
fying {F, TC} — 0, but also, satisfying the more relaxed condition {F, Ti.} — cTC 
for some c G M (see Remark^l. We observe that a nonautononious first integral 
(-F2) is required to prove integrability of the problem, in spite of the fact that 
the problem is autonomous. 

5 The sub-Riemannian nilpotent case (2,3,5) 

The sub-Riemannian (SR) problem concerns to characterize geodesies in some 
n dimensional SR-manifold M, i.e. to find absolutely continuous curves t i— > 
q{t) £ M , < t < T, minimizing length 





- -f Xl Ul X31P3 - 2tn, F3 = 03 
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such that q{t) G A(5(t))\{0} a.e. t, where A is a constant rank m < n dis- 
tribution with a (degenerate) Riemannian metric 3 on A, and < •, • > is the 
scalar product induced by g. The SR-problem can be locally formulated as an 
optimal control problem [2]: let (?7, q) be a chart on which A is generated by an 
orthogonal basis {Xi, . . . , then the SR-problem ([/, A, g) is equivalent to 

m 

rin, g(0 =^M,(OX^(<zW)- 

i=l 

The nilpotent case (2, 3, 5) is the instance where m = 2, n = 5, and the 
Lie algebra generated by Xi and X2 is a complete nilpotent Lie algebra of 
nildegree 3. On other words, if [•,•] denotes the Lie bracket of vector fields, 
— [Xi, X2], X4 = [Xi, Xz] and X^ = [X2, X5], the SR-problem is nilpotent of 
type (2, 3, 5) if Xi(0) = Q g|- for some q 7^ G R and i e {1, . . . , 5}; which gives 
dim({Xi,X2}) = 2, dim({li,X2,X3}) = 3 and dim({Xi, X2, X3, X4, X5}) = 
5. The true Hamiltonian is then given by H{q,^p) = ^X^Hi^K^)' where 
hi{t) =< tp{t),Xi{t) > for i G {1, . . . , m}, and the Poincare system is a system of 
equations on T*U, given by completing the set {Xi, . . . , X„} to form a smooth 
basis oiTU. Such vector fields are obtained by extending hi{t) —< 'ilj{t), Xi{t) > 
to « e {l,...,n} and computing hi — ^i^i{hi, hj} hj, where {•,•} is the n 
bracket. 

Y. Sachkov proved in J3] that the optimal control associated with the sub- 
Riemannian nilpotent case (2, 3, 5) is solvable, by obtaining three first integrals 
and using them to reduce the Hamiltonian system to the differential equation 
(){t) = ci cos{9{t)) + C2 sin{9{t)) for ci,C2,9{t) G M. Hence, the solvabihty is ob- 
tained from previous works showing that such differential equation is integrable 
by quadratures using Jacobian Elliptic Functions. The autonomous Hamilto- 
nian Ti. is one of the first integrals used, and the other two and are 
obtained as a direct consequence of the fact that the Lie algebra is nilpotent, 
since {hi,hj} —< -0, [X^, Xj] (g) > imply that /i4(i) = and /i5(t) = along 
solutions. 

With the method presented in this work, we can obtain enough first integrals 
to directly prove the solvability of the problem. In fact, we will consider a more 
general problem, parameterized by constants a,f3 & {0,1}. Consider the SR 
nilpotent case (2, 3, 3 -I- a -f f3) with local generators for A given by 

9 d d a 2 d ^ d 

Ai = - — and X2 = ^ hxi- 1- 77 \- pxiX2^ — . 

0x1 0x2 0x3 2 0x4 0x5 

The distribution A is known as the nilpotent Heisenberg distribution (a = 
and /3 = 0), the nilpotent Engel distribution {a — 1 and /3 = 0), or the Cartan 
distribution (a = 1 and (3 = 1). The Pontryagin maximum principle gives the 
true Hamiltonian 

1 r ct 
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This class of problems admit the following set of generators (cf. 'H'): 
f 3 1 1 

T = AH + A^ ^4 = -^AV4, - ^A^xi, Ui = -l-X^ui,X2 = ^A^xs + ^A^, 
2 2 2 2 p 

U2 = ^X''u2,X5 = X^X3 + ^X^X5 + A^X4 = ^Ai.T4 + X\X3 = X'x3 + A^^l . 

Computing F(A) on Lemma^and finding solutions for Theorem^) we have the 
effective first integrals (not in involution) 

{'Ha,p, -02 + Plp5X3, ■03, ^04, f3^5}- 

Lemma 2. The sub-Riemannian nilpotent cases (2,3) (a — and (3 — 0), 
(2,3,4) (a — I and f3 — 0), and (2,3,5) (a — 1 and [3 — \), are integrahle by 
quadratures. 

It is not difficult to find a first integral F whereas the set {H, F, tp^, ■04, ■05} 
is involutive. Such first integral should satisfy the relations {Ti, F} = and 
{F, 0i} — for i e {3,4,5}. If we consider a priori that F does not depend 
on X3, X4 or xq, then last condition is trivially verified. Hence, it just remains 
to solve {H, F{xi,X2,tpi, ■ ■ ■ , tps)} — 0, which by a direct calculation gives the 
first integral 

F ^ -■010^5 + -0204 - (0'3 + ■^ll^5X2)x2lp5- 

Therefore, the solutions of the sub-Riemannian nilpotent case (2, 3, 5) are Liou- 
villian, using the first integrals {TL, F, 03, 0^4, ^05} in involution. 

Although the present method can be applied to other hard problems, such 
as the sub-Riemannian nilpotent cases (2,3,5,8) or (2,3,5,8,14), for which 
the solvability is still unknown, because of its complexity (8 and 14 effective 
first integrals are needed, respectively), their study is left for a forthcoming 
publication. Here we just notice that the Maple package described in j2| is 
unable to find a sufficient rich family of first integrals for the case (2, 3, 5, 8, 14). 
Therefore, they need to be found by other theoretical procedure. 
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